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Description 



DIRECTIONAL INTERPOLATION METHOD 
USING DCT INFORMATION AND 
RELATED DEVICE 

Background of Invention 
[0001] i. Field of the Invention 

[0002] The present invention relates to directional interpolation 
of an image, and more particularly, to a method for per- 
forming directional interpolation using Discrete Cosine 
Transform (DCT) information and a related device. 

[0003] 2. Description of the Prior Art 

[0004] Traditional interpolation methods assume that a two- 
dimensional image to be interpolated consists of a plural- 
ity of one-dimensional images, and therefore, the two- 
dimensional image is interpolated vertically or horizon- 
tally. Such treatment may introduce unwanted zigzag 
edges of objects in the image. Some directional interpola- 
tion methods have been proposed to solve the above- 



mentioned problem. 
[0005] as shown in Fig.l,the ELA algorithm (ref. T. Doyle and M. 
Looymans, Progressive scan conversion using edge infor- 
mation. In: L. Chiariglione, ed. Signal Processing of HDTV 
II, Elsevier Science Publishers B.V., North-Holland, pp. 
711-721, 1990) is typical of the directional interpolation 
methods known in the art. Firstly, a direction correspond- 
ing to a pair of pixels having a minimum difference be- 
tween their pixel values is selected from among three di- 
rections 131, 132, 133. The pixel values typically repre- 
sent brightness and/or color levels of each pixel. For ex- 
ample, pixels 111, 123 are substantially equivalent and 
the difference between the values of the pixels 111, 123 
is therefore smaller than the difference between the val- 
ues of pixels 112, 122 and smaller than the difference be- 
tween the values of pixels 113, 121. Because of this, di- 
rectional interpolation should be performed along the di- 
rection 131. That is, the interpolated pixel 152 is derived 
from averaging the values of the pixels 111, 123. As 
shown in Fig. 2, pixels 201, 202, 203 are interpolated ver- 
tically while pixels 211, 212, 213 are interpolated along 
an edge 215 of an object 210 of an interpolated image. 
The shading shown for each pixel in Fig. 2 denotes a hy- 



pothetical pixel value after interpolation. It is evident in 
this example that the zigzag edge problem is solved by 
using directional interpolation. For more information 
about variations of the ELA algorithm, please refer to U.S. 
Pat. No.5,742,348 and U.S. Pat. No.6, 133,957. 
[0006] However, the above-mentioned directional interpolation 

algorithm introduces a new problem of faulty treatment of 
images with noise. Specifically, noise will decrease the 
correctness of the selection of the edge direction using 
the pixel values. Therefore, if the interpolation direction is 
determined according to the incorrectly selected edge di- 
rection, the directional interpolation will not work prop- 
erly. 

Summary of Invention 

[0007] it is therefore an objective of the claimed invention to 

provide a method for performing directional interpolation 
using Discrete Cosine Transform (DCT) information and a 
related device to solve the above-mentioned problem. 

[0008] According to the claimed invention, provided is a method 
for interpolating a pixel within an image. The image has a 
plurality of pixels arranged in a matrix format. The 
method includes detecting if there is an edge in a block of 
the image according to DCT data of the block. The pixel is 



located within the block. The method further includes if 
the edge is detected, determining an interpolation direc- 
tion of the pixel according to the DCT data, and interpo- 
lating the pixel according to the interpolation direction. 
The method further includes if no edge is detected, inter- 
polating the pixel vertically or horizontally. 

[0009] The present invention further provides a device for inter- 
polating a pixel within an image. The image has a plurality 
of pixels arranged in a matrix format. The device includes 
a detection unit for detecting an edge in a block of the 
image according to DCT data of the block. The pixel is lo- 
cated within the block. The method further includes a 
processing unit electrically coupled to the detection unit 
for determining an interpolation direction of the pixel ac- 
cording to DCT data and a detection result generated by 
the detection unit. The method further includes an inter- 
polation unit electrically coupled to the detection unit and 
the processing unit for interpolating the pixel. Wherein if 
the edge is detected, the interpolation unit interpolates 
the pixel according to the interpolation direction, and if 
no edge is detected, the interpolation unit interpolates the 
pixel vertically or horizontally. 

[0010] it is an advantage of the present invention method and 



device that the edge direction detected by the present in- 
vention method and the present invention device is more 
accurate than that of the prior art, and therefore, the per- 
formance of the directional interpolation of the interpo- 
lated image is improved. 
[0011] These and other objectives of the present invention will no 
doubt become obvious to those of ordinary skill in the art 
after reading the following detailed description of the pre- 
ferred embodiment that is illustrated in the various fig- 
ures and drawings. 
Brief Description of Drawings 

[0012] pig.l is a hypothetical representation of a portion of an 
image interpolated by a directional interpolation method 
according to the prior art. 

[0013] Fig. 2 is a hypothetical representation of a portion of an 

image interpolated by different interpolation methods ac- 
cording to the prior art. 

[0014] pig. 3 is a flowchart illustrating steps of a method of pixel 
interpolation according to a first embodiment the present 
invention. 

[0015] Fig. 4 is a block diagram of a video processing device ac- 
cording to the present invention. 
[0016] Fig. 5 is a block diagram of the video decoder shown in 



Fig.4. 

[0017] pig. 6 is a hypothetical representation of the DCT coeffi- 
cients relating to the method shown in Fig. 3. 
[0018] pig. 7 is a lookup table used in the method shown in Fig. 3. 

[0019] Fig. 8 is a diagram of edge directions corresponding to the 
edge indexes shown in Fig. 7. 

[0020] Fig. 9 is a hypothetical representation of the high fre- 
quency portion of the DCT coefficients shown in Fig. 6. 

[0021] Fig. 10 is a flowchart illustrating steps of a method of pixel 
interpolation according to a second embodiment the 
present invention. 
Detailed Description 

[0022] please refer to Fig. 3, Fig.4, and Fig. 5 at the same time. 
Fig. 3 is a flowchart illustrating steps of a method for in- 
terpolating a pixel within an image according to a first 
embodiment the present invention. The image has a plu- 
rality of pixels arranged in a matrix format. Fig.4 is a 
block diagram of a video processing device 400 for imple- 
menting the method shown in Fig. 3. In the first embodi- 
ment, the video processing device 400 includes a video 
decoder 410 and a video format converter 430 including a 
detection unit 432, a processing unit 434, and an interpo- 



lation unit 436, all integrated into a microchip. As shown 
in Fig. 5, which is well known in the art, the video decoder 
410 is capable of generating frequency information and 
pixel information of an image during a video decoding 
process according to encoded data of the image. The fre- 
quency information can be the Discrete Cosine Transform 
(DCT) data relating to the image, and more particularly, 
the DCT coefficients of an image block. The pixel infor- 
mation are pixel values of the image. Of concern, the pixel 
values are typically values that represent the brightness 
and/or color levels of each pixel. The video format con- 
verter 430 is capable of interpolating a pixel within the 
image according to the DCT coefficients and the pixel val- 
ues. The first method of the present invention is de- 
scribed as follows: 
[0023] step 3 10:Generate the DCT coefficients of the block with 
the video decoder 410 according to encoded data of the 
image. 

[0024] step 320:Detect if there is an edge in a block of the image 
with the detection unit 432 according to the DCT coeffi- 
cients of the block, within which the pixel is located. 

[0025] step 330:lf an edge is detected, determine an interpola- 
tion direction of the pixel with the processing unit 434 



according to the DCT coefficients, and interpolate the 
pixel with the interpolation unit 436 according to the in- 
terpolation direction. 

[0026] step 340:lf no edge is detected, interpolate the pixel ver- 
tically or horizontally with the interpolation unit 436. 

[0027] As shown in Fig. 6, the above-mentioned DCT coefficients 
include a plurality of low frequency DCT coefficients C 
and C . Step 320 utilizes the low frequency DCT coeffi- 
cients C and C to detect the edge. In step 320, the de- 
01 10 a K 

tection unit 432 compares the low frequency DCT coeffi- 
cients C and C with a threshold TH_no_edge to detect 

01 10 a 

the edge. If the low frequency DCT coefficient C Q1 is 
smaller than the threshold TH_no_edge and the low fre- 
quency DCT coefficient C is smaller than the threshold 

10 

TH_no_edge, no edge is detected. Therefore, the interpo- 
lation unit 436 interpolates the pixel vertically or horizon- 
tally as described in step 340. Otherwise, an edge is de- 
tected and then, in step 330, the processing unit 434 de- 
termines the interpolation direction according to a differ- 
ence ( I C l-l C I ) between the absolute values I C 1,1 

01 10 01 

C I of the low frequency DCT coefficients C and C 
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and according to the signs of the low frequency DCT coef- 
ficients C and C . The processing unit 434 includes a 
01 10 M 3 



lookup table corresponding to the low frequency DCT co- 
efficients C and C , and the processing unit 434 is ca- 

01 10 K a 

pable of determining the interpolation direction according 

to the lookup table. Please note, the above-mentioned 

lookup table can be replaced by a specific arithmetic unit 

(not shown) for generating a calculation result according 

to the low frequency DCT coefficients C and C , and 
M 7 01 10' 

the processing unit is capable of determining the interpo- 
lation direction according to the calculation result. That is, 
the function of the specific arithmetic unit is equivalent to 
the function of the lookup table and therefore, the specific 
arithmetic unit maps the same way as that shown in Fig. 7 
illustrating the lookup table. 
[0028] please refer to Fig. 3, Fig. 6, Fig. 7, and Fig. 8 at the same 
time. Fig. 7 illustrates the lookup table or the function of 
the specific arithmetic unit used in step 330. Fig. 8 illus- 
trates detected edge directions corresponding to the edge 
indexes [0], [1], [7] shown in Fig. 7. The operation re- 
sults of "sign(C ) = = sign(C )" of step 330 are listed in 
3 oi 3 10 K 

the first row of the table shown in Fig. 7. The operation re- 
sult "1" denotes that the signs of the low frequency DCT 

coefficients C and C are equivalent, and the operation 
01 10 M K 

result "0" denotes that the signs of the low frequency DCT 



coefficients C and C are different. The possible ranges 
01 10 

of the operation results of " I C l-l C I" of step 330 are 
K 01 10 K 

listed in the second row of the table. Please note, the 
thresholds TH1, TH2 are positive values derived from ex- 
perimental results of test images or trial processes relat- 
ing to the present invention method and device. The value 
of TH1 is greater than the value of TH2. The third row of 
the table contains the edge directions corresponding to 
the first and second rows of the table. As a result, the 
processing unit 434 determines the interpolation direction 
to be one of the edge directions shown in Fig. 8 according 
to the table shown in Fig. 7. 
[0029] pig. 9 is a hypothetical representation of the high fre- 
quency portion of the DCT coefficients shown in Fig. 6. 
The DCT coefficients include a plurality of high frequency 
DCT coefficients. The block "DC" denotes the Direct Cur- 
rent (DC) DCT coefficients C and "AC" denotes the other 
DCT coefficients. The second embodiment of the present 
invention is similar to the first embodiment with an ex- 
ception that the processing unit 434 further compares the 
high frequency DCT coefficients with a threshold 
TH_multi_dir to detect edges having different directions. 
The processing unit 434 is capable of comparing one of 



the high frequency DCT coefficients with the threshold 
TH_multi_dir to detect the edges having different direc- 
tions. If one of the high frequency DCT coefficients is 
greater than the threshold TH_multi_dir, edges having dif- 
ferent directions are detected, and therefore, the process- 
ing unit 434 interpolates the pixel vertically or horizon- 
tally. That is, the interpolation direction should be in ei- 
ther the vertical or horizontal directions. A revised 
flowchart is illustrated in Fig. 10. In step 330b, the pro- 
cessing unit 434 is capable of detecting if there are a plu- 
rality of edges having different directions in the block ac- 
cording to the high frequency DCT coefficients and a re- 
vised version of the table of the processing unit 434. 
[0030] a third embodiment of the present invention is similar to 
the second embodiment with an exception that the 
above-mentioned comparison using the threshold 
TH_multi_dir is varied. According to the third embodi- 
ment, the present invention further includes comparing an 
average of the high frequency DCT coefficients with the 
threshold TH_multi_dir to detect edges having different 
directions. 

[0031] please note that the video processing device 400 can also 
be implemented by replacing the video decoder 410 with 



a video encoder 410 having an inversed process flow 
when compared with the video decoder 410 shown in 
Fig. 5. Therefore, in a fourth embodiment, which is similar 
to the first embodiment, Step 310 is revised as follows: 

[0032] step 310' :Generate the DCT coefficients with the video 
encoder 410 according to raw data of the image. 

[0033] | n contrast to the prior art, the present invention method 
utilizes the frequency information of a block surrounding 
the interpolated pixel. The edge direction detected by the 
present invention method and the present invention de- 
vice is more accurate and less sensitive to noise than that 
in the prior art, and therefore, the performance of the di- 
rectional interpolation of the interpolated image is im- 
proved. 

[0034] | t j S another alteration that the present invention method 
and device can couple to other directional interpolation 
algorithm to verify the edge direction further, and there- 
fore, the accuracy of the directional interpolation is im- 
proved. 

[0035] it is another advantage of the present invention method 

and device that the DCT data is readily available in a video 
encoder or a video decoder, and therefore, the implemen- 
tation of the present invention is easy to achieve. 



[0036] Those skilled in the art will readily observe that numerous 
modifications and alterations of the device may be made 
while retaining the teachings of the invention. Accord- 
ingly, the above disclosure should be construed as limited 
only by the metes and bounds of the appended claims. 



